# Local deployment optimization

Bielik-4.5B-v3.0-Instruct-GGUF is a Polish large language model released by SpeakLeash, converted from Bielik-4.5B-v3.0-Instruct to GGUF quantized format, suitable for local inference.

This is an approximate implementation version of the ServiceNow-AI's Apriel-5B-Instruct model converted to Llama format, compatible with mainstream fine-tuning frameworks for easier operation.

This is a quantized version of Google Gemma 3B model, optimized based on llama.cpp, suitable for running in resource-limited environments.

DeepSeek-R1 is a 1.58-bit dynamically quantized large language model optimized by Unsloth, adopting the MoE architecture and supporting English task processing.

GGUF format file of the e5-base-v2 embedding model, used for tasks such as sentence similarity calculation, supporting a maximum context of 512 tokens.

The first Polish dialogue assistant model specifically designed for local deployment, based on TinyLlama-1.1B with extended Polish tokenizer and trained with DPO optimization

1.3B parameter GPT-NeoX model pretrained on 31.3GB Vietnamese data